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ABSTRACT 


Two new applications of established techniques for mea- 
suring an individual's level of stress (workload) in tracking 
imisks are presented, An andirect technique of measuring 
"reserve capacity" is utilized in a two-axis cross-coupled 
eompensatory tracking task. A direct psychophysiological 
measurement is made by recording time histories of operator 
pupil diameter. 

hResul@syObvained indicate that each method yields a good 
index of workload, although considerable variance in the data 
is observed. The level of instability in the second axis of 
the cross-adaptive method is shown to be related to the level 
of workload in the Sat axis. Increased pupil diameter is 
Saovwn to be similarly related. to operator workload. The 
simultaneous application of both techniques is determined to 


be inappropriate. 
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heavune pertormance. €omplexity ana cost of modern aircraft 
weapons systems continue to accelerate, the physical and 
mental demands imposed upon their pilots become unmanageable. 
To operate within the narrowing margins of safety and effec- 
meveness, pilots can no longer tolerate large attentional 
demands. 

The Heelcorent Ol sbocsted hydraulic controlesystens has 
igeeuced the physical loads on the pillot to a@ minimum, but the 
eaceregate of mental loads, although reduced significantly in 
fecent years, has hardly reached its nadir. The level of 
mescarch activity in this area of workload reduction continues 
meeetemain high and the development of related equipment has 
progressed from simple autopilots to complex inertial guidance 
and navigation systems, from gyro horizons to situation indi- 
cators and flight directors, from the well-known "joy stick" 
jo the new side-mounted hand controller. These devices have 
all been designed to increase the pilot's performance in the 
modern arena of the air by reducing his attentional demands; 
ie. , iis mental workload. 

The term workload refers here to a level of stress or the 
amount of effort expended to achieve a certain level of 
performance. Workload and performance are thus inter-connected 
but distinct. Kelley [Ref. 1] has shown that performance 
measurements are not in themselves valid workload indicators 


and that under certain circumstances increased performance 





can be achieved at higher levels of performance-measured work- 
load, and vice versa. Reference 2 similarly demonstrates this 
fact during an evaluation of helicopter autopilots. 

This important distinction between workload and performance 
womeoe exemplified by the case of two jet aircraft performing 
pmowene Carrier landing. One of the aircraft is equipped with 
an approach power compensator (an automatic throttle), and the 
Sumer 1S not. Now consider the pilots. Both must achieve the 
same high level of performance to bring the aircraft aboard 
but their levels of workload are considerably different. 

aus. inorder to properly evaluate an aircrait system or 
MiemetiLect of changes within that system, both operator 
performance and workload measurements must be taken. 

fevnods of measuring performance are now quite standard 
and commonly use some function of "system error" as the 
fercerion. Methods of determining workload, however, have 
yet to be completely developed. There exists no "meter" which 
when plugged into the complex man-machine system gives direct 
readings of workload. The various techniques which have been 
employed in past research can be grouped into three 
eavepories: 


ime subjective evaluations (pilot ratings) 
2. measurement of "reserve capacity" 


Be measurement of psychophysiological responses 
emmely and in combination, these techniques have been shown 


to be relatively reliable indicators of workload. 
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Pilot ratings, when properly used, have been regarded as 
the most effective of these techniques and have been used to 
correlate or validate the other workload measures [Refs. 3,4]. 
By definition, however, these ratings are operator-variant and 
require a certain level of experience upon which to base the 
mematatbion. In view of these requirements and in light of 
previous validation of the methods employed in this research 
by pilot rating (Refs.4,5], this technique was not investigated. 

ims, im an attempt GO provide a simple, operator—invarianc 
method of workload measurement, this thesis has made use of 
techniques (2) and (3), above. The application of a cross- 
a@apcive unstable tracking task was used to measure reserve 
@epoacity and the recording of changes in pupil diameter was 
used as the psychophysiological measure. Both methods were 
examined while subjects performed a compensatory tracking 


task. 
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ie THEORY 


Poe hE SERVE CAPACITY 

In the field of manual control the term "reserve capacity" 
Mem ‘excess control capacity") is used to indicate the differ- 
ence between an operator's maximum control capacity and that 
mnoltiev Laken up by the particular task he is performing. The 
normalized ratio of this absorbed amount to the total amount 
feeeconurol is the atventional demand of the task, or Simply 
the level of workload the task places on the operator. Thus 
by measuring this reserve capacity one is led to the "level 


emerworkioad": 


. attentional demand _ , _ reserve capacity 
Level of Workload = toOvual cCapeciuy = i. total capacity 


(1) 
Note that the maximum level of workload, as defined here, is 
Dra Gy . 
ine Cpevator Loading Tasks 

The most common method of determining the reserve 
capacity is to load an operator with an additional, secondary 
task. This task may take several forms; a separate tracking 
task, a mental task (e.g. solving mathematical problems), or 
a responsive task (e.g. responding to light signals by pushing 
mae correct button). 

The reserve capacity of the operator can be measured 


in several ways. In the method most frequently used, the 


operator's performance on the primary (original) task is 


ne 





Severmined, from this a criterion is established. and the 
Speravor 1s told to maintain ents euen of performance 
maeOushnourt the task. The level of difficulty of the secondary 
(loading) task is increased until the operator reaches the 
point where he can no longer meet the primary task performance 
eemverion. This level of secondary task difficulty then 
becomes the measure of the operator's reserve capacity. 

Knowles [Ref. 6] provides an excellent summary of 
this loading rationale and of early work in the area. 

2. Cross-Adaptive Systems 

A problem frequently encountered in using these 
fewmencdary 1Oading techniques 1S the diiiteulty of consvurainane 
fae Drimary task performance. Although instructed otherwise, 
faeoperator may divert his attention from the primary task and 
Focus on the secondary, particularly when the secondary level 
mmraitficulty ce Halen Thus AirS *orimary task perro mace 
deteriorates and the resulting higher level of difficulty he 
can tolerate in the secondary task is no longer a valid 
measure of his reserve capacity. 

The so-called cross-adaptive technique overcomes this 
problem by automatically adjusting the level of difficulty on 
the secondary task on the basis of primary task performance. 
Although the operator may become distracted by a very diffi- 
cult secondary task causing a lower level of performance in 
the primary, the adaptive system will sense the poorer per- 
formance and reduce the level of difficulty. The distraction 


is thus reduced and the primary task performance returns to 


ES 





eEMmesGesired level. In this way the operator is constrained 
tO maintain the prescribed level of primary performance and 
an accurate measure of his reserve capacity can then be made. 

A schematic of this type system is shown in Fig. (11). 

Kelley [Ref. 7] points out that there are three 
elements of such an adaptive system. They are: (1) a method 
of measuring performance, (2) an adjustable parameter which 
eaemees the level of difficulty (called the adaptive variable) 
and (3) the adaptive logic which automatically changes the 
adaptive variable as a function of the performance measurement. 

The specific application of these elements to this 
imeescas 1s described in Section ILI. 

becrivical Tnstapillivty Task 

ina report which te “generat wecemded as ve clic me 
in the field of control theory, McRuer et al. [Ref. 8] pre- 
sented a Pe tplSe MAchGat teem formulation, of “a human opera: or 
in a compensatory tracking task. This quasi-linear model 
momen stS Of a linear describing function and the remaining 
non-linearities which are grouped and referred to as "remnant." 
This remnant is thought to be caused by non-linear or unsteady 
meeracvor behavior and by the superposition of noise on the 
Secracor's linear output. 

A simplified model of the human describing function, 
termed the "cross-over" model, was found to give a fairly good 
representation of the human operator under certain circum- 
seances. it consisted principally of a pure operator gain 


(K,) and an effective time delay oe This t, term is shown 
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moeoc a random vartable consisping sof various operator delays, 
Haes and high frequency leads. | 

Jex et al. (Ref. 9] proved that when an operator is 
controlling a first-order divergent element with transfer 
iene ton 8) = —- » the maximum value of A under which 
control can be maintained is approximately equal to the 
Mayerse of the operator's effective time delay. This 
instability level is termed "critical" Or) and provides a 
semple and direct measure of an operator's tracking ability. 

dae task in Which A’ 1s slowly wend amoencvoniceal) 
macheased during a run until control is lost is called the 
"Neritical task." A similar task in which A is maintained 
at some controllable value is called the "sub-critical task." 

Applications Of this Critical (acleappeer alam eloas 
mmmeme area Of human response research. it 1s Currently 
emoloyed by a number of experimenters as an indicator orf 
psychomotor performance. In particular, Jex [Ref. 10] has 
ep iaed this task to a two-axis tracking system in which the 
Buamary Cask consisted of the critical task. The seperate 
secondary task consisted of the sub-critical task. He demon- 
Simeacved that noticeable decreases in the value of ro aichte ved 
in the primary task were obtained with only slight increases 


ime ohe secondary level of instability, and that the combined 


tasks could be used for workload research. 


Bae PSYCHOPHYSIOLOGICAL MEASUREMENT 
Uesvyenophystolopical GS a Combamavtom Of Che A2g¢ieceulves 


Peyenolosical and physiological and refers to the: inseparable 


ne 





connection of the mental and neuromuscular responses of the 
human operator. Since these aeeenicee are consicered to be 
G@arectly related to the operator's state of stress (workload), 
Chey have been measured quite extensively as both monitors 

and indicators of workload. Analyses of such psychophysio- 
logical responses as.heart and respiration rates, galvanic 
skin response, electrocardiograms and electroencephalograms 
have been performed. 

Spyker et al. [Ref. 4] performed a complex analysis of 
sixty-four such responses during a two-axis tracking task. 
Using a considerable amount of interface and data processing 
eauapment he arrived at a reliable workload index consisting 
of ten of these responses. 

femineman |Rer. ll) recorded and comand) Meum uingee 
responses, including the somewhat unusual measurement of 
Smonees in the subject’s pupil size, during a paced mental 
task. He observed that this pupil size variation provided 
Miemmost Consistent results. 

The technique of pupillometry, or the method of measuring 
eneamees in pupil size, has primarily remained in the realm oF 
the behavioral scientist. The preliminary work of Hess and 
mole (Ref. 12] initiated a surge of research in this area 
which resulted in the acclamation of pupillometry as a very 
effective indicator of the human condition. It has been 
Bimevi  cCOLIncdicate an dandividual’s alrvicgudes and preference. 
[Ref. 13], prejudices [Ref. 14], sexual arousal [Ref. 15], 


even latent homosexual tendencies [Ref. 16]. Pupillary 
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variations have been used to indicate psychiatric disorders 
[Ref. 17], as well as physical ills [Ref. 18]. Hess [Ref. 19] 
provides an excellent assessment and summary of the more 
important research performed in these areas. 

Cognitive demand experiments, i.e., those requiring mental 
effort, have also been performed and related pupil changes to 
levels of mental activity. Hope [Ref. 20] showed that in- 
eeeasing levels of difficulty in a mental arithmetic problem 
mooted In proportionate pupil dilations and noted che 
mmemomena Of pupillary constriction when the difficulty level 
MememreoxCeSSive, causing incorrect replies. He referred to 
mes aS a mental “overload.” 

Payne et al. [Ref. 21] reported that changes in pupil 
Giameter were a sensitive and reliable indicator of informa- 
mom processing capacity and were related to levels of 
workload. 

Edwards [Ref. 22] showed similar correlation with infor- 
mation processing and reported the same pupil constriction 


for mental overloads as shown by Hope [20]. 


ee 





Tit. EXPER EMENE 


A. APPLICATION OF THEORY 
ee racking Tasks 
a. Cross-Adaptive 
WO Ver tet ems LOl Vi ic re wirsoarl task? Were  seGmac 

the primary and secondary tasks in a cross-adaptive system. 
ime sub-critical task served as the controlled element of the 
primary task, and a variable sub-critical (i.e., where A 
varies continuously at levels below se), was used as the 
secondary (loading) task. This was done for several reasons: 

(1) The critical task is simple, easily 
mechanized and can be used on a small analog computer. 

(2) The level of instability (A) is directly 
related to the level of difficulty of the task and can be 
used both to set the level of difficulty for the primary task 
(the basis for workload comparison) and to vary the level in 
the secondary task (thus becoming the adaptive variable). 

(3) The tasks required no input. The random 
operator remnant is sufficient to excite and maintain the 


unstable tasks. 


1 athough the term “critical” speecitically srermers: ve yrme 
eritical instability task in which A is monotonically 
increased until reaching ’A_, it has, been common to refer to 
the general (i.e., first-order divergent) compensatory 
tracking task from which »A. is obtained as the critical task. 
Unless otherwise noted, thé author has used the term in this 
Beweora Sense. 
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()eTn@ addition to its =iumetion as the 
adaptive variable, the secondary instability becomes the 
madirect measure of primary task workload. 

The performance measure employed, although not 
memoooOniSticated as desired, was the deviation of the absolute 
value of the primary task error — from a fixed criterion 
(ep). The criterion was established by determining the rms 
maemo tne principal subject during tracking runs ar a 
median level of primary task instability Cd, ) and was set at 
M5 ecm. (of displayed error). Thus primary task performance 


ee is defined: 


| (2) 


The adaptive logic used was similarly simple. 


da 
The time rate of change of the adaptive variable ( = ) was 


feoraled To Po in a manner similar to Kelley's approach 


meee. 7, p. 554] iie., 


ee aa (3) 


where the gain (K) is set: 
2 
K = O24 rad cm.—sec- (4) 


To prevent excessive instability rates and to 
provide the operator with a greater ODVCrLUunivy Fo recamn 


control, the rate was limited in the following manner: 


da : 
a = 0.14 rad./sec*, P, 2 0.35 (5) 


IL 





ee = 0.26 rad./secs, ae -0.65 (6) 


TiS Vnemactien Opeth aTOl we meccaed cle Clraverion . 
ee secondary task instability rate decreased almost twice as 
fast as it increased when he tracked within the criterion. 

A further limit was placed on the instability to 
Meevent the secondary task from ever becoming stable which, 
ieecars particular mechanization, would cause control 
fmeversal. Thus: 

d = 
> ae 0.16 rad./sec. (7) 
An initial value of instability Or. ) was provided 
O 


memrnsure that the operator was loaded in both axes at the 


Bepinning of the run. This relatively low initial value was; 
= =) slo rade cece. (8) 


A diagram of the cross-adaptive system is shown 

Momae., (2). 
b. Single-Axis Sub-Critical 

In order to provide a common ground for comparing 
the two different methods of workload measurement, the pri- 
many cask alone had to be performed for pupillometric 
measurements. By disconnecting both the secondary task and 
the cross-adaptive network, the single-axis sub-critical task 


Wes, ceneraced. 





Ge SoInele-tres. Cru ca l 


. was used to determine each 


The critical task 
Pepject's tracking skz#il and level of proiticiency during the 
experiment. It was used to normalize measured instabilivy 
levels obtained during the tracking tasks and to indicate the 
weve) of total control capacity. 

Although an automatic, rate-switched mechanism 
(autopacer) was recommended by Jex et al. [9], this was not 
possible in this experimental set-up and the value of Me had 
to be obtained by manually increasing the level of instability 
on the task from zero to the point where control was lost. 

Peer upd)., Diamever 
The results obtained by Kahneman [11] and by 

Anderson [Ref. 23] led to the selection of pupil diameter 
changes as the psychophysiological indicator of workload. 
The authors indicated a correlation between level of diffi- 
culty and pupil size variation and utilized Want Ormay.on 


processing capacity" in a manner analogous to the use of 


"reserve capacity" in this study. 


B. PROCEDURE 
WM euerers subjects>, chosen on the basis of motivation, 


availability and previous tracking or flying experience, 





¢ Now used in its specific sense (i.e., hk D 


3geveral other subjects were considered to provide a 
larger and more meaningful data base. After several trial 
runs they had to be rejected due to eye characteristics Cine 
little contrast between iris and pupil or partial covering of 
peemouol! by the eyelid) which caused the pupil measuring 
equipment to give erroneous readines. A similar difficulty 
was reported by Burns [24]. 
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pert ormea thegeritical tracking tasks described previously. 
The tasks were mechanized on a small analog computer accord- 
mae co Ghe Circuit diagram shown in Fig. (24). Tracking 
emrors were displayed as the displacement of a dot from the 
womeereor a cathode ray tube (CRT) located 15.5 in. (39.4 em.) 
ier rony Of the subject's eye. 

Soaurol was alfected with an isemetrice (force) svick. 
mae Controller was mounted on a tablet. arm to provide forearm 
Support and positioned slightly ahead and to the right of the 
Subjects, who were all right-handed. To reduce operator 
fatigue and to allow higher response frequencies, the sensi- 
ivy OL the controller was set at a fairly high level. 
The ratio of display deflection to control force was 2.84 
meeytb., (1.62 cm./N). 

Semcanuous pupil diameter measurements were made Using 
a Space Sciences Model 831 Television Pupillometer. This 
device uses a closed-circuit television system to observe 
mae eye and a signal processing unit to measure and display 
pupil diameter. The eye was illuminated by a small, near- 
iairared, low-intensity light source which was mounted to 
Seeeside of the adjustable camera. The subject's head was 
poeteoned 1n a brace consisting of a chin support and a 
forehead restraint (Fig. 3). An integral two-channel strip 
echart recorder in the processing unit recorded pupil diameter 
in a range from zero to ten millimeters. The second channel 
was used to record either secondary task instability (A) 


Gumiie the €ross-adaplive task, or displayed error ey 
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Meine the sub-critical tracking runs. An additional 
meecorcder was also used to record total displayed error 

(en = le, | + fe) during the cross-adaptive runs. A picture 
of the experimental set-up is shown in Fig. (4). 

peavea before the display, ceachmwsubject positioned his 
head comfortably in the rece rane White Toecusing sen. Ghe 
center of the elevated CRT. The display was raised 14.5 
fereeees above eye level to force the subject to look up, 
thus providing better illumination of the eye and removing 
moyermeertierence between the eyelid and pupil. 

The experiments were performed in an acoustically pro- 
meevecad chamber with constant, dim back lighting. The chamber 
(eemrocaved.in the Human Engineering haboratory of the Naval 
Ee@eresraduate School. | 

ime experiments were divided into three phases, each 
mereresponding to the different tracking tasks to be performed. 
Mrene the initial phase the subject Was given a warm-up 
period to become familiar with the task and to achieve a 
relatively stable performance level. He was then asked to 
perform the cross~-adaptive critical task, and reminded that 
control of the primary task was paramount. This meant that 
he should try to keep the vertical position of the dot 
(indicating Ta) in the center of the CRT as much as possible 
or to center it as quickly as possible when displaced. He 
was requested to keep the horizontal position of the dot 


ce.) at least within five cm. of the center. 


zo 





nysertes Ol runs, “each lasting from 90 to 150 seconds, 
were then performed at various levels of primary task insta- 
DPeeicy. Table Ja. indicates the number of runs performed by 
the subjects at each of these levels. 

macordi nes Of Secondary task-instabalivy and total error 
were made during each run. Although this experimental phase 
was primarily aimed at obtaining values of Ne as a workload 
indicator, pupillary reactions were recorded to determine if 
amy correlation existed between pupil dilation and de: 

ie tne second experimental phase, "subjects: performed the 
eelcoical instability task in the vertical axis. Hach subject 
performed the task five times with run lengths averaging 20 
meso seconds. Values of do were recorded along with the 
subsidiary measurement of pupil diameter. Figure (5) shows 
emeeypical time history of ne Crivical ask t0Ssvapdlaty 
levels and pupillary variations. 

The final phase of the experiment consisted of having the 
subjects perform a series of sub-critical single-axis tracking 
weeks at the same instability levels Or) SUIS aig) ale 
cross~-adaptive tasks. Measurements of pupil diameter and of 
displayed error (e,) were recorded. The number of runs per 
subject at each level of primary instability is shown in 


iaole Ib. 


CGC. DATA ANALYSIS 
To reduce the effects of inter-subject variation, che 


recorded data was normalized. Instability levels were 
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represented as a percentage of the subject's mean critical 
value of instability CA,); oar 
i # = =22* s 100 (9) 
P;s ce 
A procedure recommended by Pratt [Ref. 25] and one commonly 
used in pupillometric measurements was to express the pupil 


diameter (D) as a percentage change from the average unloaded 


initial diameter (Do); i.e., 


D* = ———— x 100 ne) 


ie T,deverminavion and averapingvor his intetatediomever . 
however, was far from simple. Figure (9) shows the wide and 
random variation of one subject's pupil diameter during two 
Pe~tods of rest following consecutive tracking runs. These 
effects are caused both by a small amount of random noise 
introduced in the optical neuromuscular system (akin to 
McRuer's "remnant" [8]) as described by Stanten and Stark 
[Ref. 26] and by operator cognitive processes (i.e., day- 
dreaming). The latter effect is presumed to be predominant 
and is eliminated when the operator is loaded and forced to 
may Lull attention to the tracking tasr. 

Mine ficpure also iIndweates that there 1 oeaecieniiacage 
difference between the mean values. Thus a determination of 
De is required for each separate mie 


In order to preclude an inordinate amount of tracking and 


data reduction time, this type analysis (i.e., numerically 


=) 


mwelaging pupil diameter every three seconds during an initial 
90 second period) was not performed. Instead, a 15-30 second 
rest period before each run was used as the baseline and the 
pupil recordings were visually averaged to obtain Do: 

Analysis of pupil measurements recorded during both the 
cross-adaptive and sub-critical tracking tasks required 
Similar averaging techniques. Although not elegant from an 
engineering viewpoint, this method provided adequate and 
fmepresentative mean data. It may have been partially respon- 
mame TYOwever, for introducing scatter ine the data. 

Purine the analysis of the instabidjaegy Gata, a consiust— 
Pmeeey recurring phenomena was observed; YPeak values of 
secondary instability Ones which indicated the highest 
meet Of instability achieved before the primary performance 
rapidly deteriorated, were noted. The pupil diameter record- 
ing also showed 3 Similar peak OU Vacthin a fewesecemas- 
These values were measured and recorded. Figure (7) indicates 
this phenomena quite clearly. 

Values of asymptotic (steady state) secondary instability 
Or.) were also visually averaged over the observed time 
intervals (At) during which they were maintained. Pupil 
diameter measurements (D..) were also averaged during this 
moeerval, and the values for each were recorded, 

Figures (6) to (8) show typical time histories of the 
variables for the three tracking tasks. 

All data was normalized and averaged for each subject 


at each level of se Except for steady state values, the 
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mean and standard deviation was calculated using standard 


Srauistical formulae, i.e., 


N 
> p4 
xX = te Pe (11) 
N 
amd 5 1/2 
N N 
y x* - {( <= x y-/N 
pe i=1 1=1 (12) 
N- 1] 
Where, 
s x $ x 
X Ns Naan Dt 4 pass 


N = number of runs 


The steady state values were weighted by the percentage 
ratio of the time interval CN ee to the total run time (tm) 
1 ae 


Wo = ee 00 (13) 


Weighted averages and standard deviations were computed 


eens the relations: 


il eee (14) 


z | 
I 


b- bi 
Tse 


and, 


rar 


1/2 


, 2 N 2 
DP we ys. = ( ee MW rye 
a ne ee sie 

_ i=l i=] 

Spee (Lb 
N- 1 
Miner = , 
= x x 
J \3s? bss 


tinemavyerasced, normalized data OCbtatmed yrs) Namie. 


are shown in Tables II to IV. 
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The principal results of this experiment are presented 
mapeetes. (10) and (11). Using the cross-adaptive critical 
tracking task as an indicator of workload, Fig. (10) shows 
the overall decrease in the steady state values of normalized 
secondary instability with increasing normalized primary 
instability. The demonstrated relationship between secondary 
instability and primary workload thus validates the cross- 
Seer ave technique. Simply stated, tmis snovs Chat yas The 
peimeary task becomes more difficult, the level of @giifi-— 
welcy maintained in the secondary task becomes less, andicacving 
the previously predicted increase in primary task workload. 
tats, the task difficulty is reflected by its workoaa@ and 
weree: Versa. 

The results of using changes in pupil diameter as a 
measure of workload are shown in Fig. Gi)’: The proportional 
relationship between level of difficulty and increase in 
pupil diameter is evident and thus reflects the increasing 
workload. An apparent increase in the rate of change of 


Smupil size is noted at approximately 50 percent of the total 


siete are presented in this figure for only two subjects. 
The third subject became rapidly fatigued during this experi- 
mental phase. This fatigue caused his eyelids to droop 
slightly which in turn interfered with the correct measure- 
Meno Of His. pupil diamever. 


ay 


G2 








operator control capacity and indicates, perhaps, a mental 
"shifting of gears" at the midpoint of this capacity. 

Due to the large variance in the data, no regression 
analyses were performed. The mean trends, however, are 
mucariy evident and support thes@heoretical hypothesis. 

Additional results obtained from the experiment are shown 
foeraigs. (12) and (13). The variance of peak values of 
mormalized primary instability is shown in Fig. (12). The 
Same trend as shown previously in Fig. (10) is evident. This 
Darameter could thus be used as an additional workload index. 

Fig. (13) shows the results of the critical task measure- 
ments. It can be seen that two subjects dilated at fairly 
wemebvant rates until reaching approximately 9O percenpc: 
memcicai, at which time the dilation rave ereavly imereaeea 
Meet reaching critical. The unexpected phenomenon of inti! 
meoitiary constriction with increasing instabilivy eis oo] 
meeved in one subject, and can be e€xXpiainedac 2a Light OF His 
Pamatted tracking strategy. 

This subject had previously performed a large number of 
sercical instability tracking tasks and= had develeopedea 
strategy which enabled him to achieve consistently high 
welues Of ae BY consciously relaxing du ie eee cary 
phases of the run when tracking is relatively simple, he would 
store control energy for the highly unstable regions 
(essentially switching from a low to a high gain). The 
pupillometer recorded this reduction in stress (workload) by 


either an accurate measurement of actual pupil constriction 
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or by the inaccurate measure of the pupil partially blocked 
by a lowered (restful) eyelid. Dilation occurred when the 

instability loaded the subject beyond his capacity to relax 
pdieis Shown to have a similarly high rate near critical. 

One additonal result was obtained with the critical task. 
mesindicated in Fig. (5), PSECU pupil constriction following 
Mmeeorol COhtrol is evident. This iS a manifestavion ofthe 
"overload" condition of Hope [20] and Edwards [22]. 

The additional measurements of changes in pupil diameter 
G@uringe the cross-adaptive task at corresponding levels of 
steady state and peak secondary instability, provided no 
discernable information. It is assumed that the complex 
imieeraction of primary and secondary tracking tasks @s seen 
woroureh the eye, made analysis of pupillary responses 
iin ic less. 

The results obtained from the cross-adaptive critical 
tracking task have been compared to those of Jex et al. 
meer. 2/ |]. Although not specifically employed to andicate 
operator workload, their more sophisticated cross-adaptive 
task, coupled with measurements of operator describing 
functions, provided three results similar to those of this 
exeeriment : 

1. Three primary task controlled elements of in- 
@reasing difficulty resulted in decreasing levels of cross- 
@oupied instability. 

2. Small increases in effective time delay and 


remnant were measured. 


ul 








3. Operator behavior (tracking strategy) in the 
primary task as determined by describing function measure- 
ments was not changed by secondary task loading, indicating 


@aac ne had not changed his primary task performance criverion. 


Bue 





V. CONCLUSIONS AND RECOMMENDATIONS 


The following conclusions concerning this research are 
drawn: 

1. This thesis has been successful in mechanizing 
two techniques for determining the level of workload of an 
@eeravor controlling a manual control system. 

2. The techniques of using the cross-adaptive criti- 
cal tracking eet and of measuring changes in pupil siZe 
meovrcae valid indices of operator workiloed, 

3. The cross-adaptive task can be mechanized ona 
small computer using simple performance measurements and logic 
which will yield results comparable to those obtained from 
larger, more complex systems. 

4, An additional workload index, the peak value of 
secondary task instability, is available and can be used to 
confirm results obtained from the two principal indices. 

5. The measurement of critical instability levels 
provides a good measure of an operator's total control 
capacity and enables the workload index to be expressed 
eoncretely. 

6. Pupil measurements are highly inter- and intra- 
subject variant. Additional variance may have been introduced 
by a relatively crude method of data reduction. 

7. The simultaneous measurement of cross-adaptive 
instability and changes in pupil diameter provides no 


meaningful data. 
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The following recommendations are offered: 

1. The cross-adaptive tracking task should be coupled 
with the recently developed hybrid describing function ana- 
lyzer [Ref. 28] as a more effective measure of workload. 

eo» Lhe Use of a Smoothing filter and yor similar 
performance measurement techniques as presented in Ref. 27 
should be incorporated in the cross-adaptive mechanization. 

3. “A more realistic and less faricumme cise, 
format should be used (e.g., a simulated artificial horizon). 

4, A method of interfacing pupillometric output with 
an off-line data processor including programs for data 
averaging should be found. This would make pupillometry more 


appealing as a workload measure for tracking tasks. 
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Pebee IS  aee 


TABLES 


TABLE I 


Number of Experimental Runs per Subject 


an 
Cross-Adaptive Tracking Task 


Primary Task Instapae.., (Ap) 
Subject Se es oO PLES 220 Ce 


RAH ~ - 6 ug 15 8 
HGC - — 4 3 3 = 
CMB D 5 5 = 5 = 


Jom 
Sub-Critical Tracking Task 


Primary Task Instability (Ap) 
eubject ore, eS ea aS Se, BD 


HGC ~ = i 3 3 7 
CMB 3 3 5 3 3 = 


by 


a 





TABLE II 


Normalized Instability Levels and Pupil Diameters 
for sSub—-Critical Tracking iask 


Normalized Primary Normalized 
Subject Instabilicy (AD *) Pupil Diameter (D#) 


(Meaney std,edev .) 


HGC 32.34 (els? (25150) 
4O. 43 12460 i Cero) 
48.51 He Se Le) 
64.70 1 A (C5 A) 

CMB gil Sigs) 4 aly 
32.89 Bo 5 oO) 
43.86 10294 (275e> 
65.195 35a) Meee vooy 
oe (iO | 50 7035 (565) 
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AV Mele ANALAL 


Normalized Instability Levels 
for Cross-Adaptive Critical Tracking Task 


Normalized Steady Normalized Peak 
Normalized Primary State Secondary secondary 
SO) . Instability aa) Instability vee) Instability ee) 





(mean 7 Standard devicuscom) 


RAH 31.64 65.06 (9.93) yeti Ts) MCLG 215) 
39.56 65.03 (4.59) (AS Sissi) 
47 47 6257/5. (oes, (5eGo le .o)) 
55.38 W326 WG 62 1 GLE 695) 
63.29 30.66. (5s07) Boe cm) 

HGC 2232 56H 02 Clleuaey 55.63 (10.58) 
40.43 66. 20 2( 35 ue BOs ceo) 
48.51 42.65 (8.22) 55.63 (10.58) 

CMB 293 19% 32) Cleese) 90.34 (9.34) 
32.89 62.79" (ome) (5S ene) 
43.86 puemiiey (2.1L y TC) 2 32 G22 49) 
65.79 7.058 “(3m0) 2G Oh Lag) 


By) 





gly Ws) ico A 


Normalized Pupil) Ditemevers 
for Cross=—Adaptive Criticameteacmine = Task 


Normalized Steady Normalized Peak 





Normalized Primary state Pupil leabyo iL. 
Subj. Myst > 4 lap Oe Diameter (D2 .) Diameter (De) 
RAH 31.64 i, OB nS sy) B50 By a5 6 SI) 
39.56 2.87 “Cine NEG Oeste )) 
47.47 0.02 (5.58) Pos5 9) CORUey) 
5S oste —5. 35 ge Ze Oe Cena 
S85 BS, —2,.56 (cin gen 123 O(a oe 
HGC 32.34 13.66. 1s 18.23 (4.84) 
40.43 16.65 (4.60) O.a0 OF clea oilly) 
48.51 BOS he 18.04 (6.37) 
CMB eA Ss 15.0613 see) Sor LS sy) 
Beno =e (20252) BoM Or eltS 4 Sya9 
43.86 -6.35 (12.91) 6200 )(g.01) 
65.79 OS Cle) JL e115 Silo, 


38 


GCVOTXYOM 
AS Vi 
AYVINIUd 


APPENDIX B 
FIGURES 





AON VN YON d 
ASVA 
AYVW Id 





DNAWNHEONS VAN, 


‘AON VNYOMU ad 


LNYWAYNS VAN 
AONVAYO Head 





(T) adnsty 


wegsAS asatgdepy-ssod9 y 


AS VL 


AYVCNOOUS 





(ATE VIUVA )F 
ALTNOLGAT 

AO 
Faia! 





OLD0T 
dAT od vav 





ASVAL 
AYVWN Td 


(LAS ) 
SES OLEC EME 
40 THARq 





YOLVEAdO 


By, 





(Z) sansty 


YSCI, TVOLTITdAD satadepy-ssod9 93u4 30 werlsgetq yootg 






} 
moos L—|-ZTH0H \e—Q<— 
l { 
| i 
| 
NOTLONOAE 
| ONTETHOSAG | ay 
| | 
l | 
| | = 
Shs ‘ VOILYEME— 
{ 4 
| | 
(4 CUWOY J 
dd HOLVYGdO NVWOH 


OTD07 S.LNYWNA Ta 
GAT Id VadvV Ca TIOULNOo STOYULNODO YOLVYAdO SAV1dSId 


40 


a 











Close-Up of Subject Tracking 
(indicating TV Pupillometer) 


Figure (3) 





Experimental Set-Up 


Figure (4) 
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Time History of Typical Cross~-Adaptive Critical Tracking Task 
(indicating steady state values) 


Figure (6) 
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Normalized Steady State Secondary Instability 
vs. Normalized Primary Instability for 
Cross~-Adaptive Task 


Figure (10) 
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Figure (ii) 
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Normalized Peak Values of Secondary Instability 
vs. 
Normalized Primary Instability 


Figure (12) 
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